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(54) Image data illegal use prevention system 

(57) An image data illegal use pra/ention system 
includes an image data fetching unit (6) for fetching dig- 
ital image data in which electronic watermark data may 
be embedded, and an electronic watermark data detec- 
tion unit (8) for detecting electronic watermark data from 
the image data fetched by the image data fetching unit 
(6). If electronic watermark data are detected by the 
electronic watermark data detection unit (8). then an 
image data recording unit (7) does not record the image 
data fetched by the image data fetching unit (6) onto a 
recording medium (9), thereby preventing illegal dupli- 
cation. The electronic watermark data are calculated, 
for example, in accordance with an expression deter- 
mined in advance for frequency components of discrete 
cosine transformed digital image data. 
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Description 

This invention relates to digital inrage processing, 
and more particularly to a system for preventing illegal 
use off digital image data. 

2. Description of the Preferred EmlxxJiment 

In recent years, illegal duplication off a digital image 
has become a problem. 

In order to prevent illegal duplication, a system has 
been proposed wherein digital image data are ciphered 
such that only a reproduction system having a legal 
decipherment key can reproduce the ciphered digital 
image data. However, once the cipher is deciphered, 
later duplication cannot be prevented. 

Thus, a system wherein a unique identrfication 
code is recorded on a recording medium to indicate per- 
mission or inhibition of duplication (refer to Japanese 
Patent LaidOpen Application No Heisei 8-6941 9), 
another system wherein decoders for subscription tele^ 
vision broadcasting have different identification codes 
from one another recorded therein such that only those 
decoders which have contracted identification codes 
can effect correct decoding (refer to Japanese Patent 
Laid-open Application No Heisei 5-260468) and so 
forth have been proposed. 

Further, in order to prevent illegal use and duplica- 
tion of a digital image, also a method has been pro- 
posed wherein special information, that is. electronic 
watennark data, is embedded into the digital image 
itself. As such electronic watermark data for a digital 
image as descn*bed above, two kinds of electronic 
watermark data off visible electronic watermark data and 
invisible electronic watermark data are available. 

The visible electronic watermark date are used 
such that a special character or symbol or the like is 
combined with an image so that it may be visually rec- 
ognized. While the visi)!e electronic watermark data 
deteriorate the picture quality, they have an effect of vis- 
ually appealing to a user of a digital image for preven- 
tton of illegal use of the digital image 

An example of embedding of vistole electronic 
watennark data is disclosed In Japanese F^ent Laki- 
Open Application No Heisei 8-241 403. Accoiding to the - 
method disclosed in the document just mentioned, 
when visible electronic watermark data are combined 
with an original image, only the brightness corrponents 
of those pixels which con-espond to opaque ones of the 
electronic watermari^ data are varied while cola com- i 
ponents of the pixels are nor varied. In this instance, the 
scaling factor by which the brightness components off 
pixels are varied is determined based on color conpo- 
nents. random numbers, values of pixels of the elec- 
tronic watennark data and so forth. 5 

On the other hand, the invisible electronic water- 
mark data are electrons watermark data embedded in 
an image so that the picture quality may not be deterfo- 



rated. Since the invisible electronic watermark data little 
deteriorate the picture quality, they are characterized in 
that they cannot be recognized visually 

However, if special information wrfiich allows kJenti- 
5 fication of an author is embedded as the electronic 
vratermark data, then even after illegal duplication is 
performed, the author can be specified by detecting the 
electronic watemiari^ data. On the other hand, if dupB- 
catfon inhibition informatfon is en*)edded, then, for 
10 example, w^en a reproduction apparatus detects the 
duplkjation inhibition informatioa it is possible to notify 
the user that duplication of the data is inhibited or to 
render a duplication prevention mechanism in the repro- 
ductfon apparatus operative to limit diplication off the 
IS data by a video tape recorder (VTR) or the like. 

One of available methods off en*>edding invisible 
electronic watermark data into a digital image is to 
embed special information as electronic watennark 
data into a portion of pixel data such as the LSB (least 
^ significant bit) which has a comparatively little influence 
on the picture quality. In other words, this method can 
be regarded as a method which inserts electronic 
watermark data into a waveform with respect to time of 
an image signal. However, where this method is 
25 applied, electronic watermark data can be removed 
readily ffrom an image. For example, if a tow-pass filter is 
used, then information of the LSB of a pixel is lost Fur- 
ther, electronic watermark data are lost also by image 
compression processing since the image compression 
30 processing reduces the data amount by removing infor- 
mation at such a portfon which has a comparatively little 
influence on the picture quality as mentioned above. 
Consequently, the method described above is disad- 
vantageous in that it is difficult to re^etect the electronic 
35 watermark data. 

Thus, another method has been proposed wheren 
an image is frequency converted and electronic water- 
mark data are embedded into a resulting frequency 
spectrum {Nif<kei Electronics, April 22. 1996. No. 660. 
#0 p.13). In this method, since electronic watermark data 
are embedded into frequency components, the elec- 
tronic vratermark data are not lost even by image 
processing such as compression processing or filtering. 
Further, random numbers which exhibit a nonnal distri- 
(5 bution are adapted as the electronic watermari^ data in 
order to prevent interference between electronic water- 
mark data and make it difficult to destroy electronic 
vwatermarkdata without having a significant influence on 
the entire image. 
0 In a method off embedding electronic watermark 
data, an original image D is divkJed into blocks of 8 pix- 
els x 8 pixels, and electronic watermark data are 
embedded regarding each block as a processing unit. 
Also extraction processing of the electronic watermari^ 
5 data is performed in units of a block. 

In electronic watemnark data enfoedding process- 
ing, data are first set successively as f(1), f(2). f(n) in 
the ascending order off the frequency component off an 
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AC component in a frequency region after disaete 
cosine transform (DCT) in MPEG (Moving Picture 
Experts Group) coding processing is completed, and 

electronic walemnark data w(1), w(2) 2{n) are 

selected from within a normal distrftxition whose aver- 5 
age is 0 and whose dispersion is 1, and then 

F(i) = f(0 + a*avg(f(i))*w(i) 

is calculated for the incfividual values of i. where a is a w 
scaling factor, and avg(f(0) is a partial average which is 
an average of absolute values of three neightxsring 
points to the point f(i). TTien, succeeding processing of 
MPEG coding processing is performed replacing fO") 
with F(i). 15 

Detection of electronic watermark data is per- 
formed in accordance with a method described t>elow. 
In the detection method, an original image is not 
required, but only it is required that electronic water- 

n^ark data cancfidates w(i) (where i » 1 , 2 n) be 20 

known. 

In a frequency region of each block after dequanti- 
2ation of MPEG decompression processing is com- 
pleted, data are represented as F(2). F(2), F(n) in the 
ascending order of the frequency component. Average 25 
values of absolute values of three neighboring points to 
each point F(i) are represented as partial averages 
avg(F(i)). and electronic watermark data W{i) are calcu- 
lated in accordance with 

30 

W(i) = F(i)/avg(Fri)). 

Further, sum totals WF(i) of W(i) for one image are cal- 
culated for the individual i. 

Thereafter, making use of an inner product of vec- 35 
tors, a statistical similarity between the electronic water- 
mark data w(i) and the sum totals WF(i) is calculated in 
accordance with 

C = WF * w/(WFD * WD) 40 

where W = (WF(1), WF(2), .... WF(n)). w =.(w(1). w(2), 
w(n)), WFD = absolute value of the vector WF. and 
wD = at)solute value of the vector w. When the statistical 
similarity C has a value higher than a particular value, it 45 
is discriminated that the electronic watermark data are 
err^edded. 

However, where the m^od described above is 
emplcyed, if image data are regarded as a mere single 
block of digital data on a personal computer, they can be so 
duplicated by a desired number of times using a copy 
command of operation system software of the Windows, 
MS-DOS (both trade marks of Microsoft) or the like. 

Further, with a system which handles a digital 
image such as a digital vkfeo recorder, a copying 55 
machine or a facsimile, since a copy of data can be pro- 
duced simply, it itself cannot be prevented that digital 
image data including electronic watermark data are 



duplicated as tfiey are. 

It is an object of the present inventwn to provide an 
image data illegal use prevention system which can pre- 
vent illegal use of digital image data without deteriora- 
tion of the FMCture quality and allows, even if cfigital 
image data are duplicated, identification of the owner- 
ship from the duplicate 

In order to attain the object desaibed above, 
according to an aspect of the present invention, there is 
provided an image data illegal use prevention system, 
conprising image data fetching means for fetching cfig- 
ital image data in which electronic watenmark data may 
be embedded, electronic watermark data detection 
means for detecting electronic watermark data from the 
image data fetched by the image data fetching mearB, 
and transfer inhtoition means for inhil)iting, if electronic 
watermark data are detected by tiie electronic water- 
nriark data detection means, transfer of the tnr^age data 
fetched by the image data fetching means to a transfer 
destination. 

According to another aspect of tiie present inven- 
tion, there is provided an image data illegal use preven- 
tion system, conprising image data fetching means for 
fetching digital image data in which electronic water- 
mark data may be enr±»edded. electronic watermark 
data detection means for detecting electronic water- 
mark data from the image data fetched by the image 
data fetching means, and transfer means for transfer- 
ring, if electronic water mark data are detected by the 
electronic watermark data detection means, data differ- 
ent from the image data fetched by the image data 
fetching means to a transfer destination. Preferat>ly, tiie 
different data are data obtained t^y superposing data 
obtained by nrujltiplying the electronic watermark data 
by a constant on the image data fetched by the image 
data fetching means. 

According to a further aspect of the present inven- 
tion, there is provided an image data illegal use preven- 
tion system, comprising image data fetching means for 
fetching digital image data in which electronic water- 
mark data may be emt>edded, electronic watermark 
data detection means for detecting the electronic water- 
mark data from the image data fetched by the image 
data fetching means, and transfer inhibition means for 
discriminating whetiier the detected electronic water- 
mark data indicate transfer permission or inhibition and 
inhibiting, when the detected elecb-onic water mark data 
indicate transfer inhibition, a transferring operation of 
the fetched inriage data to a transfer destination. Prefer- 
ably, the transfer inhibition means discriminates, when 
tiie detected elertronic watermark data include a value 
representing that the transfer permission time number is 
zero, tiiat the detected electronic watermark data are 
electronic watermark data incficating transfer inhibition. 

According to a still further aspect of tiie present 
invention, there is provided an image data illegal use 
inhtoition system, comprising image data fetching 
means fa fetching digital image data in which electronic 



BNSOOCID: <EP 0854633A2 I > 



3 



5 



EP0 854 633 A2 



6 



watermark data including a value Irxiicating that the 
transfer permission time number is m may be embed- 
ded, watermark data embedding means for embedding, 
into the fetched image data, new electronic watermark 
data which ir»cludes a value Indicating that the transfer 
permission time number is smaller by one than the pre- 
ceding value of m. and transfer nneans for transfening 
the image data in whk;h the new electronk; watermark 
data are embedded to a transfer destination. 

In the image data illegal use inhibition systems, the 
electronic watermark data may be calculated in accord- 
ance with a predetermined expressk)n using frequency 
components of the digital image data obtained by dis- 
crete cosine transform. Otiienvise, any cf the image 
data illegal use inhibition system may be constructed 
such that the image data fetching means fetches digital 
image data from a recording medium on which the dig- 
ital image data are recorded, and the transfer destina* 
tion is a recording medium different from the recording 
medium on which the digital image data are recorded. 

It is to be noted that, in the present specification, 
the word "transfer" includes transmission of digital 
image data from a source by or in which the digital 
image data are produced or stored to another elenDent 
storage of such digital image data Into or onto another 
medium, duplication of digital image data from a record- 
ing medium in which the digital image data are recorded 
to another recording medium, duplication of a file by a 
computer and so forth and should be interpreted widely 
as any operation which makes digital image data in 
such a form as allows use of the digital image data 

With the image data illegal use prevention systems 
described atx3ve. di^^lication of image data can be pre- 
vented without deterioration of the picture quality using 
an electronic watermark technk^ue. Consequentiy. the 
image data illegal use prevention systems can be 
applied to various image processing systems. 

Further, illegal copying can be prevented without 
any limitation to a medium of copying source data and 
to a medium of a copying destination, and even if data 
are copied illegally, if copyright data are embedded as 
watermark data in the data, then a person who has the 
ownership of the image data can be identified by inves- 
tigating the watermark data and a person who has per- 
formed illegal duplication can be specified. 

The above and other objects, features arKi advan- 
tages of the present invention will become apparent 
from the following description and the appended claims, 
taken in conjunction with the accompanying drawings in 
which like parts or elements are denoted by like refer- 
ence characters. 

FIG. 1 is a block diagram showing a t>ask: construc- 
tion of an image data illegal use prevention system 
according to the present invention: 
FIG. 2 is a block diagram showing an exemplary 
construction of a watermark data embedding unit 
shown in FIG. 1 ; 



FIG. 3 is a block diagram showing an exemplary 
construction of a watermark data detection unit 
shown in FIG. 1; 

FIG. 4 is a block diagram of a digital video system 
5 to which the image data illegal use preventk>n sys- 
tem of FIG. 1 is applied; 

FIG. 5 is a block diagram of a digital copying system 
to which ttie image data illegal use prevention sys- 
tem of FIG. 1 is applied; 

10 FIG. 6 is a block cfiagram of a form of an image pro- 
duction and recording apparatus shown in FIG. 1 
where it is formed as a printer system; 
FIG 7 is a block diagram of a form of an image 
duplication apparatus stKwvn In FIG. 1 where it is 

15 formed as a facsinrile system; 

FIG. 8 is a block diagram of another form of the 
image duplication apparatus shown in FIG. 1 where 
it is formed as a capture board system; 
FIG. 9 is a block cfiagram of a data transfer system 

20 to which an intage data illegal use prevention sys- 
tem according to the present invention is applied; 
FIG. 10 is a flow chart illustrating operation of the 
data transfer system of FIG. 9; arxj 
FIG. 11 is a block diagram showing an exemplary 

25 constiruction of a watermark data detection/embed- 
ding unit shown in FIG. 9. 

FIG. 1 shows a basic construction of an inr^ge data 
illegal use preventfon system to which the present 

30 invention is applied. The image data illegal use preven- 
tion system includes two principal components of an 
image production and recording apparatus 100 and an 
image duplication apparatus 101. The image production 
and recording apparatus 100 Is composed of an inrtage 

35 data production unit 1, a watemriark data embedding 
unit 2. a watemnark data table 3 and an image recording 
unit 4. Meanwhile, the image duplication apparatus 101 
is connposed of an image data fetching unit 5. an image 
data recording unit 7 and a watermark data detection 

40 unit 8. 

In the Image production and recording apparatus 
1 00. digital Image data produced by the rnrage data pro- 
ductfon unit 1 are sent to the watermark data embed- 
ding unit 2. The watermark data embedding unit 2 

45 Inserts electronic watermark data of the watermark data 
table 3 into the digital Image data In such a manner as 
hereinafter described. The image data recording unit 4 
records the digital image data, in which tiie electronic 
watermark data are embedded, onto a recording 

so medium 5. 

In the image duplication apparatus 101, the image 
data fetching unit 6 fetches the digital image data 
recorded on the recording medium 5. The watermark 
data detection unit 8 detects the electrons watermark 

55 data in the digital inrtage data fetched by ttie image data 
fetching unit 6 in such a manner as hereinafter 
descrft>ed. The image data recording unit 7 records. If 
the image data fetching unit 6 does not detect electronfo 
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watermark data, the digital image data onto another 
recording medium 9 to produce a duplicate, but does 
not perform, rf electronic watermark data are detected, 
recording of, the digital Image data onto the recording 
medium 9. 5 

FIG. 2 shows an exemplary construction of the 
watermark data enrtbedding unit 2. Digital image data 
from the image data production unit 1 of FIG. 1 , thalis, 
discrete cosine transformed MPEG image data, are 
inputted to a partial average calculation section 111 arxj io 
an adder 114. The digital Image data are represented 
as f(i) (i = 1. 2. .... n) for the convenience of description. 

The partial average calculation section 111 calcu- 
lates partial averages descrit>ed hereinabove in accord- 
ance with arg(f(i)) = (|f(i-1)| + |f(i)| + |f(i+1)|)/3 and is 
supplies a result of the calculation to one of input termi- 
nals of a multiplier 1 12. 

To the other input terminal of the multiplier 112. 
electronic watermark data w(i) are supplied from the 
watermark data table 3. An output of the multiplier 112 20 
is multiplied by a scaling factor a by a multiplier 1 13. and 
a result of the multiplication is added to the digital image 
data by the adder 1 14. A result of the addition, that is. 
image data (f(i) + a * arg(f{i)) * w(i)) in which the elec- 
tronic watermark data are embedded, are obtained from 25 
the adder 114 and supplied to the image data recording 
unit 4 of FIG. 1. 

FIG. 3 shows an exanrple of a construction of the 
watennark data detection unit 8. Data Ffi) fetched by 
the image data fetching unit 6 of FIG. 1 are supplied to 30 
a partial average calculation section 115 and a divider 
116. The partial average calculatton section 115 calcu- 
lates partial averages avg(F(i)) mentioned hereinalxjve. 
This calculation is performed, for example, in accord- 
ance with avg(F(i)) (|F(i-1| + |F{i)| + |F(i+1)D/3 . The 35 
divider 1 1 6 perfonns calculation of W(i) = F(i)/avg(F(i)) . 

Then, an adder 117 calculates, for the individual 
values of i, sum totals WF(i) of the thus calculated val- 
ues W(0 for one image. Then, the sum totals WF(i) are 
supplied to an inner product calculation section 1 1 8, k>y 40 
which inner products thereof with electronic watermark 
data w(i) of an object of detection are calculated. The 
calculation of the inner product calculation section 118 
is represented in tiie folkDwing manner. 

45 

C = WF*w/(WFD*wD) 

where WF is a vector whose elements are WF(1). 
WF(2), .... WF(n), w is a vector whose elements are 
w(1), w(2). .... w(n), WFD is an absolute value off the so 
vector WF, and wD is an absolute value off tiie vector w. 

The inner product calculation section 118 calcu- 
lates inner products C for all of possible ones off elec- 
tronic watermark data and supplies the inner products C 
to a similarity discrimination section 119. ss 

The similarity disaimination section 119 detects 
those electronic watermark data which maximize tfie 
inner products C, and sends out a result of the detection 



to the image data recording ur^ 7 of FIG. 1 . 

FIG. 4 shows a digital video system to which the 
image data illegal use prevention system of FIG. 1 is 
applied. Referring to FIG. 4, in the digital video system 
shown, the image production and recorcfing apparatus 
100 shown in FIG. 1 is fomned as a vkieo camera 100A 
and the image diq}lication apparatus 101 is formed as a 
video recorder 101A. 

In the video camera 100A, an image in^ged t>y an 
imaging section 1 1 is sent as cfigital image data to a 
watermark data embedcfing section 12. Meanwhile, 
electronic watermark data to be embedded into digital 
image data are stored in a watermark data table 13. 
Thus, the electronic watermark data are read cut from 
the watermark data tat>le 13 and sent to the electronic 
watermark data embedding section 12. The watermark 
data emt>edding section 12 inserts the elecbx>nic water- 
maxk data into the cfigital image data sent thereto in 
such a manner as described above. The digital image 
data in which the electronic watermark data are inserted 
are stored onto a recording medium 15 such as a mag- 
netic tape or an optical disk by a recording section 1 4. 

When a duplicate is to be produced, the digital 
image data stored on the recording medium 15 are 
reproduced by a reproduction section 16 of the video 
recorder 101 A. Normally, the digital image data are 
stored onto a recording medium 1 9 again by a recording 
section 17 to produce a duplicate. However, if electronic 
watermark data are inserted in the digital image data 
reproduced by the reproductiwi section 16. that is, if 
electronic watermark data are detected by a watermark 
data detection section 18. then such detection is 
reported to the recording section 17. When the detec- 
tion of electronic watermark data is reported, the 
recording section 17 does not perform storage of the 
digital image data onto the recorcfing medium 19, 
tiiereby preventing illegal duplication. 

Alternatively, when electronic watermark data are 
detected, dummy data may be supplied to the recording 
section 17 or data obtained by multiplying the water- 
mark data stored in the watermark data detection sec- 
tion 18 by a constant so that the data may have a 
nnaximum magnitude substantially equivalent to the 
dynamic range of the image data may be added to 
reproduced image data and sent to the recording sec- 
tion 17. If such data are supplied to the recording sec- 
tion 1 7. then an image quite different from the original 
image is outputted from the recording section 17, and 
consequently, illegal duplication can be prevented even 
rf a duplication operation is not inhibited. 

FIG. 5 shows a digital copying system to which the 
image data illegal use prevention system shown in FIG. 
1 IS applied. Referring to FIG. 5. in the digital copying 
system shown, the image production and recording 
apparatus 100 shown in FIG. 1 is formed as a first cop- 
ying macNne 100B and the image duplication appara- 
tus 101 is formed as a second copying niachine 101B. 

An original image 20 fetched by a scanning section 
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21 of the first copying machine 100B is sent as digital 
Image data to a watermark data embedding section 22. 
Meanwhile, electronic watermark data to be embedded 
into digital image data are stored in a watermark data 
table 23, and they are read out from the watermark data 5 
table 23 and sent to the watermark data en*edding 
section 22. The watermark data embedding section 22 
inserts the electronic watermark data into the digital 
image data sent thereta The dgital image data in which 
the electronic watermark data are inserted are printed u 
on copy paper 25 by a printing section 24. 

In the second copying machine 101 B, the image 
printed on the copy paper 25 is fetched and converted 
back into digital image data by a scanning sectkm 26. 
Normally, the digital image data are printed on copy 75 
paper 29 again by a printing section 27 to produce a 
duplicate. However, if electronic watermark data are 
inserted in the digital inage data fetched by the scan- 
ning section 26. that is. if electronic watermark data are 
detected by a watermark data detection section 28, then 20 
such detection is reported to the printing section 27. 
The printing section 27 does not perform, when the 
detection of electronic watermark data is reported, 
printing of the digital image data onto the copy paper 29. 
thereby preventing illegal copying. 25 

Aitemativ^y, when the electronic watermark data 
are detected, dummy data may be supplied to the print- 
ing section 27 a data obtained by multiplying the water- 
mark data stored in the watermark data detection 
section 28 by a constant so that they may have a maxi- 30 
mum magnitude substantially equal to the dynamic 
range of the image data may be added to (superposed 
on) the reproduced image data and sent to the printing 
section 27. If such data are supplied to the printing sec- 
tion, then an image quite different from the original 3S 
image is outputled from the printing section 27. Conse- 
quently. Olegal copying can be prevented even if a copy- 
ing operation is not inhibited. 

FIG. 6 shows a printer system which makes use of 
a personal computer. Refening to FIG. 6, the printer 40 
system 100C shown operates as the Image production 
and recording apparatus 100 described hereinabove 
with reference to FIG. 1. In the printer system 100C, 
electronic watermark data to be embedded into digital 
image data are stored in a watermark data table 33. A 45 
watemrtark data embedding section 32 inserts the elec- 
t-onic watermark data from the watermark data table 33 
into digital image data sent thereto from a personal 
computer 31 and sends resulting data to a printir^ sec- 
tion 34. The printing section 34 prints the digital image so 
data, in which the electronic watermark data are 
inserted, on print paper 35. Consequently, even if it is 
tried to duplicate the digital image data using, for exam- 
ple, the copying machine 101 B of FIG. 5. since the elec- 
tronic watermari< data are deeded by tfie watermark 55 
data detection section 28. illegal copying can be pre- 
vented. 

FIG. 7 shows a tacsimile system. Refening to FIG 



7, tfie facsimile system 101C shown operates as tiie the 
image duplication apparatus 101 desaibed herein- 
above witii reference to FIG. 1. In the facsimile system 
101c. when image data transmitted through a tele- 
phone line are received by a modem 41 , tite image data 
are normally sent to a printing section 42, by which they 
are printed on facsimile paper 44. Where tiie received 
image data are digital image representing an image in 
which electronic watermark data are inserted like an 
image printed, for example, by the printer system lOOC 
of FIG. 6, it is checked by a watermark data detection 
section 43 whetiier or not electronic watermark data are 
inserted In the digital image data H elecb-onic water- 
mark data are detected tiien such detection is reported 
to ttie printing section 42. When the detection of elec- 
ti-onic watermark data is reported, tiie printing section 
42 does not perform a printing operation, thereby pre- 
venting illegal duplication. 

Alternatively, if electronic watermark data are 
detected, then dummy data may be stpplied to the 
printing section 42 or data obtained multiplying tfie 
watermark data stored in tiie watennark data detection 
section 43 by a constant so that tiiey may have a maxi- 
mum magnitude sut)stantially equal to tfie dynamic 
range of tiie image data may be added to (superposed 
on) ttie restored image data and sent to the printing sec- 
tion 42. If such data are received by the printing section 
42. ttien an image quite different from ttie aiginal image 
is outputted from the printing section 42. Consequentiy. 
illegal printing can be prevented even if a printing oper- 
ation is not inhibited. 

FIG. 8 shows a capture toard system. Refemng to 
FIG. 8, the capture board system 101 D shown operates 
as the the image duplication apparatus 101 descnlsed 
hereinabove witii reference to FIG. 1. In the capture 
board system 101D, image data fetched by image data 
fetching unit 51 are normally sent to a capture appara- 
tus 52, by which they are stored into an external storage 
apparatus 54. If tiie image data are digital image data in 
which electronic watermark data are inserted like an 
image stored, for example, by tiie video camera 1 0OA of 
FIG. 4. then it is checked by an electronk; watermark 
data detection apparatus 53 whether or not electronic 
vraterniark data are inserted in the digital image data If 
electronic waternwk data are detected, then such 
detection is reported to the capture apparatus 52. The 
capture apparatus 52 does not perfonn, when such 
detection of electi'onk; watermark data is reported, a 
staring operatbn of data, thereby preventing illegal 
duplication. 

Atternatively, if electronic watermark data are 
delected, then dummy data may be supplied to the cap- 
ture apparatus 52 or data obtained by multiplying tiie 
waternwk data stored in ttie watennari^ data detection 
apparatus 53 by a constant so that tiiey may have a 
maximum magnitude suljstantially equal to tiie dynamic 
range of ttie image data may be added to (superposed 
on) ttie restored image data and sent to ttie capture 



BNSCOCID: <EP 08S4e33A2 I > 



6 



11 



EP0854 633A2 



12 



apparatus 52. If such data are received by the capture 
apparatus, then an image quite different from the origi- 
nal image is outputted from the capture apparatus 52. 
Consequently, illegal storage can be prevented even if a 
storing operation is not inhibited. 5 

FIG- 9 shows a data transfer system to which an 
image data illegal use prevention system according to 
the present invention is applied. In the data transfer sys- 
tem, data are transfenred from a storage unit of a trans- 
fer source to a storage unit of a transfer destination so 10 
that they may be copied. Referring to FIG. 9, an input- 
ting unit 61 checks whether a not there is a command 
inputted thereta If an inputted commarxJ is present 
then it is analyzed by a copy command analyse unit 62 
what the inputted command ia If it is discriminated, as a is 
result of the analysis, that the inputted command is a 
command to copy transfer source data 69 of a storage 
medium 66 of a transfer source to a transfer destination 
data area 70 of a storage medium 67 of a transfer des- 
ignation, then a commarxJ is sent to a copying process- so 
ing execution unit 63 so that copying processing may l:>e 
executed. The copying processing execution unit 63 
transfers the transfer source data 69 stored in the stor- 
age medium 66 of the transfer destination to temporary 
storage unit 65 and then causes the thus transferred 2S 
data 69 to be checked by a watermark data detec- 
tion/embedding unit 64. The watermark data detec- 
tion/embedding unit 64 detects presence or absence of 
watennark data in the data 69 and discrinninates. if 
watemnark data are detected, which one of permission 30 
and inhibition of copying the watenmark data indicate. 

If a result of detection of watermark data indicates 
permission of copying, then the transfer source data 69 
stored in the tenporary storage unit 65 are copied into 
the transfer destination data area 70 of the storage 35 
medium 67. However, if the detected waternrrark data 
indicates permission of copying by m times, than 
dequantized data in which new watermark data are 
embedded are sent from the watermark data detec- 
tion/embedding unit 64 to the copying processing exe- 40 
cution unit 63 and stored into the transfer destination 
data area 70 of the storage medium 67 of the transfer 
destination, and copying is executed. Then, information 
representing what coping has been performed by the 
copying processing execution unit 63 is sent to and dis- 45 
played by display unit 68, thereby ending the copying 
processing. If the detected watermark data incficate 
inhibition of copying, then no copying is performed. 

Subsequently, operation of copying processing by 
the data transfer system of FIG. 9 is descrit>ed with ref- so 
erence to a flow chart of FIG. 1 0. 

The copying processing execution unit 63 reads out 
the transfer source data 69 from the storage medium 66 
of the transfer source in step A1 . In step A2, the transfer 
source data 69 are inputted to the copy command anal- ss 
ysis unit 62, by which a header of MPEG data is ana- 
lyzed to discriminate whether or not the data are MPEG 
image data. 



If the transfer source data 69 are MPEG image 
data, then variable length decoding processing for 
dequantized data is performed in step A3, and the vari- 
able length coded data are dequantized in step A4. The 
dequantized data are supplied to ttie waternwk data 
detection/embedding unit 64. by which watermark data 
are detected. In step A6, discrimination of the detected 
watermari^ data is performed. 

If the watermartt data detected in step A5 indicate 
inhtoition of copying, ttien the control jumps without 
doing anything to step A13, in which the processing is 
ended. 

If the watermark data detected in step A5 indicate 
ttiat there is no limitation to the number of times in cop- 
ying, the control jumps to step A1 2, in which the transfer 
source data 69 are copied into the transfer destination 
data area 70, whereafter the control jumps to step A13. 
in which the processing is ended. 

If the waternr^ark data detected in step AS indicate 
permission of copying by m (m = 1 to k) times, m is 
i^xlated to m = nf>-1 in step A7. Then. In step A8, water- 
mark data indicating permission of copying by m times 
are embedded into the data dequantized in step A4. 

Then, if m ^ 0 in step A9. ttien tiie data into which 
ttie watermark data indicating permission of copying by 
m times have been ennbedded in step A8 are quantized 
in step A10. The quantized data are variable length 
coded in step A11. The data variable lengtfi coded and 
converted into MPEG image data are inputted in step 
A1 2 to the copying processing execution unit 63, by 
which copying processing of them s performed. 

If m < 0 in step A9, then since ttiis signifies that cop- 
ying is inhibited, tiie processing is ended. 

Subsequently, an exemplary construction of tfie 
watermark data detection/embedding unit 64 is 
descn"bed witti reference to FIG. 11. The watermarit 
data detection/enr*>edding unit 64 is formed from an 
electronic watermaric data embedding section 64A and 
an electronic watermark data detection section 64B. 

The electronic watermark data detection section 
64B has a construction same as tiiat of the watermark 
data detection unit 8 shown in FIG. 3. and the MPEG 
data F(l) decoded in step A3 of FIG. 10 are supplied to 
tfie partial average cateulation section 1 1 1 and the mul- 
tiplier 112. The partial average calculation section 1 1 1 
calculates partial averages avg(F(i)) mentioned herein- 
above. The divkJer 116 performs calculation of 
W(i) = F(|-)/avg(F(i)). 

Then, tfie adder 117 calculates, for ttie Individual i, 
sum totals WF(i) of ttie calculated values W(i) for one 
image. Then, the sum totals WF(i) are supplied to the 
inner product calculation section 1 18. by which inner 
product calculation with the watermark data w(i) is per- 
formed. 

The inner product calculation section 118 calcu- 
lates inner products C for all of possible watermark data 
and supplies the thus calculated inner products C to the 
similarity dSsaimination section 119. 
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The similarity disCTimination section 119 detects 
that watermark data with which the inner product C 
exhibits a maximum value, and sends out a result of the 
detection to the copying processing execution unit 63 of 
FIG. 9. 

The electronic watermark data embedding section 
64A has a construction same as that of the watermaric 
data embedding unit 2 shown in FIG. 2, and the transfer 
source data from which the original watermark data 
have been renxjved in step A5 of FIG. 1 0 are inputted to io 
the partial average cateulation section 111 and the 
adder 114. 

The partial average calculation section 111 cateu- 
lates a partial average described hereinabove and sup- 
plies a result of the calculation to one of input tenninals is 
of the multiplier 112. 

To the other input terminal of the multiplier 1 12, the 
watenmark data w(i) which indicate the value of m deter- 
mined in step A7 of FIG. 10 are supplied. An output of 
the multiplier 112 is nrujftiplied by a scaling factor a by 2a 
the multiplier 113, and a result of the multiplication Is 
added to the digital image data by the adder 114. A 
result of the addition, that is, image data 
(Fp) + a * arg{f(i)) * w(i)) in which the new watermark 
data are embedded, are obtained from the adder 114 25 
and supplied to the copying processing execution unit 
63 of FIG. 9. 

Having now fully described the invention, it will be 
apparent to one of ordinary skill in the art that many 
changes and modifications can be made thereto without 30 
departing from the spirit and scope of the invention as 
set forth herein. 

Claims 

35 

1. An image data illegal use prevention system, char- 
acterized in that it conrprises: 

image data fetching means (6: 16; 26; 41; 51) 
for fetching digital image data in which elec- 40 
tronic watermark data may be embedded; 
electronic watermark data detection means (8; 
18; 28; 43; 53) for detecting electronic water- 
mark data from tiie image data fetched by said 
image data fetching means (6; 16; 26; 41 ; 51); 4S 
arxJ 

transfer inhibition means (7; 17; 27; 42; 52) for 
inhtoiting, if electronic watermark data are 
detected by said electronic watermark data 
detection means (8; 18; 28; 43; 53), transfer of so 
the image data fetched by said image data 
fetching means (1 : 1 1 ; 21 ; 31 ; 61) to a transfer 
destination (9; 19; 29; 44; 54). 

2. An image data illegal use pra^ention system, char- 55 
acterized in that it comprises: 

image data fetching means (6; 16; 26; 41 ; 51) 



for fetching digrtal image data in which elec- 
tronic watermark data may be embedded; 
electronk; watermark data detection means (8; 
18; 28; 43; 53) for detecting electronic water- 
mark data from the image data fetched by said 
image data fetching means (6; 16; 26; 41 ; 51); 
and 

transfer means (7; 17; 27; 42; 52) for transfer- 
ring, if electronic water mark data are detected 
by said electronic watermark data detection 
means (8; 18; 28; 43; 53), data differenl from 
the image data fetched by said Image data 
fetching means (1; 1 1 ; 21 ; 31 ; 61) to a transfer 
destination (9; 19; 29; 44; 54). 

3. An image data illegal use inhibition system as set 
forth in daim 2. characterized in that the cfifferent 
data are data obtained by superposing data 
obtained by multiplying tiie electronic watenmark 
data by a constant on the image data fetched by 
said image data fetching means (6; 16; 26; 41 ; 51). 

4. An image data illegal use prevention system, char- 
acterized in tiiat it comprises: 

image data fetching means (66) for fetching 
digital image data in which electronic water- 
mark data may be embecWed; 
electronic watermark data detection means 
(64) for detecting the electronic watermark data 
from the image data fetched by sakf image data 
fetching means (66); and 
transfer inhbition means (63) for discriminating 
whether tiie detected electronic watermark 
data indicate transfer permission or inhibition 
and inhibiting, when the detected electrons 
water mark data indicate transfer inhibition, a 
transfening operation of the fetched image 
data to a transfer destination (67). 

5. An image data illegal use inhibition system as set 
forth in claim 4. characterized in that said transfer 
inhfoition means (63) discriminates, when the 
detected electronic watermark data include a value 
representing that tiie transfer permission time 
number is zero, that the detected electronic water- 
mark data are electronic watermark data indicating 
transfer inhibition. 

6. An image data illegal use inhibition system, charac- 
terized in that it comprises: 

image data f^ching means (66) for fetching 
digital image data in which electronic water- 
mark data including a value indicating tiiat the 
transfer permission time number is m may be 
embedded; 

watermark data embedding means (64) for 
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embedding, into the fetched image data, new 
electronic watemfiark data which includes a 
value indicating that the transfer permission 
time number is smaller by one than tfie preced- 
ing valued m; and 5 
transfer means (63) for transferring the image 
data in which the new electronic watermark 
data are embedded to a transfer destination 
(67). 

10 

7. An image data Olegal use inhtt^ition system as set 
forth in any one of dainis 1 to 6. characterized in 
that the electronic waternnark data are calculated in 
accordance with a predetemiined expression using 
frequency components of the digital image data is 
obtained by disaete cosine transform 

8. An \wage data Olegal use inhibition system as set 
forth in any one of claims 1 to 7. characterized in 
that said image data fetching means (6; 1 6; 26; 41 ; so 
51 ; 66) fetches digital image data from a recordng 
medium (5; 15; 25; 35; 69) on which the digital 
image data are recorded, arxi the transfer destina- 
tion Is a recording medium (9; 19; 29; 44; 54. 70) 
different from the recording medium (5; 15; 25; 35; 25 
69) on which the digital image data are recorded. 
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(54) Image data Illegal use prevention system 

(57) An image data illegal use prevention system 
includes an image data fetching unit (6) for fetching dig- 
ital image data in which electronic watermark data may 
be embedded. arxJ an electronic watermark data detec- 
tion unit (8) for detecting electronic watermark data from 
the image data fetched by the image data fetching unit 
(6). If e;lectronic watermark data are detected by the 
electronic watermark data detection unit (8). then an 
image data recording unit (7) does not record the image 
data fetched by the image data fetching unit (6) onto a 
recording medium (9). thereby preventing illegal dupli- 
cation. The electronic watermark data are cakxitated, 
fa example, in accordance with an expression deter- 
mined in advance for frequency components of disaete 
cosine transformed digital inriage data. 
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